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Purpose  of  the  User  Manual 


The  major  purpose  of  the  User  Manual  is  to  provide  students,  teachers, 
counselors,  and  other  school  personnel  with  a  set  of  practical  instruments  and 
procedures  designed  to  measure  the  generalizable  mathematics  skills  of  stu¬ 
dents  in  secondary  vocational  programs.  Three  types  of  assessment  instru¬ 
ments  and  procedures  were  developed,  and  are  presented  and  discussed:  (a) 
Student  Self-Ratings,  (b)  Teacher  Ratings,  and  (c)  Performance  Test. 

The  User  Manual  is  organized  around  five  major  sections:  The  first  sec¬ 
tion  describes  the  list  of  generalizable  mathematics  skill  areas  and  skills.  The 
second,  third,  and  fourth  sections  describe  the  Student  Self-Ratings  Instru¬ 
ment,  Teacher  Ratings  Instrument,  and  Performance  Test,  respectively. 
These  three  sections  provide  information  regarding  the  assessment  procedures 
that  include:  (a)  instrument  development,  (b)  item  analysis,  (c)  reliability, 
(d)  validity,  (e)  administration,  (f)  scoring,  and  (g)  uses.  The  fifth  section 
describes  how  the  Student  Self-Ratings  and  Teacher  Ratings  can  be  used  in 
combination  with  the  Performance  Test  assessment  instrument  and  how  the 
scores  may  be  used  and  interpreted.  Further,  the  appendices  present  the 
list  of  generalizable  skills  color  charts,  additional  important  mathematics 
skills,  Student  Self-Ratings,  Teacher  Ratings,  Performance  Test,  Skill  Pro¬ 
files,  and  Performance  Test  Answer  Key. 

The  generalizable  mathematics  skills  assessment  instruments,  strategies, 
and  procedures  may  be  used  for  identifying  the  functional  learning  abilities 
and  problems  of  students  having  difficulty  in  successfully  completing  voca¬ 
tional  programs.  After  identifying  students'  mathematics  skill  levels,  teachers 
will  have  a  basis  on  which  to  present  and  deliver  the  instructional,  remedial, 
and  support  services  necessary  for  students  to  succeed  in  their  chosen  pro¬ 
grams.  The  assessment  instruments  are  not  intended  as  screening  devices  for 


admission  or  exclusion  purposes,  but  are  intended  for  diagnostic  and  pre¬ 
scriptive  purposes.  The  information  contained  in  the  User  Manual  and  the 
information  obtained  from  the  assessments  can  be  used  in  individualized  and 
group  planning,  assessment,  curriculum  development,  instruction,  and  eval¬ 
uation  activities. 


-2- 


Generalizable  Mathematics  Skills 


The  generalizable  mathematics  skills  identified  and  validated  in  the  sec¬ 
ondary  vocational  programs  and  occupations  in  the  State  of  Illinois  were  used 
as  a  basis  for  developing  the  assessment  strategies  and  procedures  contained 
in  this  User  Manual.  A  generalizable  mathematics  skill  is  a  skill  which  is 
basic  to,  necessary  for  success  in,  and  transferable  (or  common)  within 
and/or  across  vocational  programs.  The  entire  report  or  executive  summary 
describing  the  skills  may  be  obtained  from  the  Illinois  State  Board  of 
Education/Department  of  Adult,  Vocational,  and  Technical  Education  and  is 
entitled,  11  Identification  of  Generalizable  Skills  in  Secondary  Vocational  Pro¬ 
grams  . 11 

The  mathematics  skills  identified  as  generalizable  within  and  across 
agricultural ;  business,  marketing,  and  management;  health;  home  economics; 
and  industrial  occupations  programs  are  illustrated  in  the  color  charts  con¬ 
tained  in  Appendix  A.  Five  categories  of  generalizable  mathematics  skills 
were  identified  and  include:  (a)  Whole  Numbers  (5  skills),  (b)  Fractions  (4 
skills),  (c)  Decimals  (6  skills),  (d)  Percent  (2  skills),  (e)  Mixed  Operations 
(4  skills),  (f)  Measurement  and  Calculation  (6  skills),  and  (g)  Estimation  (1 
skill ) . 

In  addition,  several  mathematics  skills  (See  Appendix  B)  were  identified 
as  important  but  not  necessarily  generalizable  in  various  individual  vocational 
programs.  Some  of  these  skills  (e.g.,  algebra,  geometry,  trigonometry )  are 
the  "higher  order"  mathematics  skills.  While  similar  skills  may  not  be  gen¬ 
eralizable  across  vocational  programs,  they  are  frequently  important  for 
success  in  various  programs  and  occupations.  Further,  proficiency  and 
mastery  in  the  generalizable  mathematics  skills  are  usually  prerequisite  to 
acquisition  of  the  "higher  order"  mathematics  skills.  The  focus  of  this  User 
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Manual,  therefore,  is  on  strategies  and  procedures  for  assessing  generalizable 
mathematics  skills  in  secondary  vocational  programs. 
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Student  Self-Ratings 


Instrument  Development 

The  purpose  of  the  generalizable  mathematics  skills  Student  Self-Ratings 
assessment  instrument  (See  Appendix  C)  is  to  assess  how  well  students  can 
perceive  or  estimate  their  own  generalizable  mathematics  skills.  The  gen¬ 
eralizable  mathematics  skills  listed  in  Appendix  A  were  used  as  a  basis  for 
systematically  developing  the  Student  Self-Ratings  assessment  instrument. 
The  skills  were  identified  through  a  combination  of  literature  reviews,  cur¬ 
riculum  analysis,  employer/worker  reviews  and  surveys,  teacher  reviews  and 
surveys,  and  other  data  sources. 

Each  of  the  generalizable  mathematics  skills  was  translated  into  7  scales 
and  28  instrument  items  and  includes:  (a)  Whole  Numbers  Scale  (5  items), 
(b)  Fractions  Scale  (4  items),  (c)  Decimals  Scale  (6  items),  (d)  Percent  Scale 
(2  items),  (e)  Mixed  Operations  Scale  (4  items),  (f)  Measurement  and 
Calculation  Scale  (6  items),  and  (g)  Estimation  Scale  (1  item).  Several  items 
in  the  Student  Self-Ratings  contain  examples  to  clarify  the  skills.  A  four- 
point  Likert  scale  based  on  "degree  of  skill"  is  used  to  measure  each  skill  and 
includes:  (a)  "I"  Cannot  Do,  (b)  "2"  Cannot  Do  Too  Well,  (c)  "3"  Can  Do 

Fairly  Well,  and  (d)  "4"  Can  Do  Well.  Directions  and  an  example  are  pro¬ 
vided  to  assist  students  in  using  the  instrument. 

Several  drafts  of  the  Student  Self-Ratings  were  developed  and  reviewed 
by  a  panel  of  experts  which  included  teachers,  students,  administrators, 
teacher  educators,  and  researchers.  The  panel's  input  regarding  content, 
design,  meaning,  clarity,  and  readability  was  used  in  producing  subsequent 
revisions  of  the  Student  Self-Ratings.  The  instrument  was  also  pilot  tested 
on  a  random  sample  of  students  in  selected  secondary  vocational  programs. 
Based  on  the  collective  feedback  from  the  panel  of  experts  and  information/ 
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data  collected  from  the  pilot  testing,  the  final  version  of  the  Generalizable 
Mathematics  Skills  Student  Self-Ratings  Assessment  instrument  was  produced. 
The  Student  Self-Ratings  was  then  considered  to  possess  a  sufficient  degree 
of  content  and  face  validity.  Extensive  field  testing  was  conducted  to  esti¬ 
mate  the  reliability  and  further  validate  the  Student  Self-Ratings. 

Reliability 

Reliability  is  concerned  with  the  extent  to  which  a  measuring  instrument 
is  capable  of  producing  measures  that  are  internally  consistent,  precise,  and 
stable.  The  reliability  of  the  Student  Self-Ratings  was  estimated  by  internal 
consistency  reliability  and  test-retest  reliability. 

Internal  Consistency  Reliability 

The  internal  consistency  reliability  of  the  total  Student  Self-Ratings 
instrument  is  .96  (Cronbach's  Coefficient  Alpha).  This  value  indicates  that 
the  instrument  is  highly  internally  consistent  and  is  measuring  a  uniform  or 
single  construct  of  generalizable  mathematics  skills.  For  fifteen  vocational 
programs  (Conservation;  Agricultural  Mechanics;  Horticulture;  Secretarial; 
Data  Processing;  Computer  Programming;  Nurse  Aide;  Practical  Nursing; 
Health  Occupations  Cooperative  Education;  Food  Service,  Production,  and 
Management;  Child  Care;  Child  Development;  Construction  and  Building 
Trades;  Electronics;  Machinist)  the  reliability  coefficients  range  from  .85  to 
.98.  The  coefficient  for  males  is  .94  and  for  females  is  .97.  The  Student 
Self-Ratings  are  also  highly  internally  consistent  for  students  with  different 
levels  of  mathematics  aptitude  as  measured  by  the  Generalizable  Mathematics 
Skills  Performance  Test  (high:  .94,  medium:  .96,  low:  .98).  In  addition, 
the  individual  and  total  coefficients  are  generally  in  the  high  .80  to  .95 
range.  The  data  indicate  that  the  Generalizable  Mathematics  Skills  Student 
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Self-Ratings  Assessment  instrument  possesses  high  internal  consistency  and  is 
a  reliable  measure  for  different  vocational  programs,  males  and  females,  and 
students  who  have  high,  average,  or  low  mathematics  aptitude. 

Test-Retest  Reliability 

The  test-retest  reliability  of  the  total  Student  Self-Ratings  instrument  is 
.81  (Pearson  Product-Moment  Correlation  Coefficient  (r)).  This  correlation 
indicates  that  the  Student  Self-Ratings  instrument  re-administered  over  time 
(14  days)  to  the  same  students  produces  similar  results,  and  is,  therefore 
capable  of  producing  stable  measures.  The  test-retest  reliability  coefficients 
for  15  vocational  programs  generally  range  from  .70  to  .99.  The  coefficients 
for  males  is  .72  and  for  females  is  .88.  The  Student  Self-Ratings  are  also 
stable  for  students  with  different  levels  of  mathematics  aptitude  (high:  .86, 
average:  .67,  low:  .97).  In  addition,  the  individual  and  total  scale  coef¬ 
ficients  are  generally  in  the  .67  to  .99  range.  Most  of  the  correlations  are 
significant  at  the  £  <  .05.,  £  <  .01.,  and/or  £  <  .001.  level  of  significance. 
The  test-retest  reliability  data  indicate  that  the  Generalizable  Mathematics 
Skills  Student  Self-Ratings  Assessment  instrument  possesses  an  acceptable 
level  of  test-retest  reliability  and  is  a  moderate  to  high  stable  measure  for 
different  vocational  programs,  males  and  females,  and  students  who  have 
high,  average,  or  low  mathematics  aptitude. 

Validity 

Validity  is  concerned  with  the  extent  to  which  an  instrument  actually 
measures  what  it  intends  to  measure.  Evidence  of  validity  is  frequently 
obtained  through  content  analysis  and  judgments  by  instrument  users  as  was 
described  in  the  instrument  development  section.  Validity  information  about  a 
measuring  instrument  may  also  be  obtained  through  comparisons  with  other 
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similar  tests  or  criterion  measures,  analysis  of  particular  psychological  traits, 
or  other  procedures.  In  addition  to  content  and  face  validity,  the  Student 
Self-Ratings  instrument  was  examined  regarding  evidence  of  construct  valid¬ 
ity. 

Construct  Validity 

The  construct  validity  of  a  measurement  instrument  is  generally  con¬ 
cerned  with  determining  what  psychological  trait(s)  the  instrument  is  actually 
measuring.  If  the  Student  Self-Ratings  have  evidence  of  construct  validity, 
they  should  produce  results  which  agree  or  are  consistent  with  the  Perfor¬ 
mance  Test  for  different  vocational  programs,  males  and  females,  and  students 
who  have  high,  average,  and  low  levels  of  mathematics  aptitude. 

The  correlation  (r)  between  the  total  Generalizable  Mathematics  Skills 
Student  Self-Ratings  and  Performance  Test  is  .40.  This  coefficient  indicates 
that  there  is  a  moderate  relationship  or  agreement  between  the  Student  Self- 
Ratings  and  Performance  Test.  The  correlations  between  the  Student  Self- 
Ratings  and  Performance  Test  for  15  vocational  programs  range  from  -.24  to 
.67.  The  coefficients  for  males  is  .20  and  for  females  is  .49.  The  correla¬ 
tions  for  students  with  different  levels  of  mathematics  aptitude  are:  (a) 
high:  .40,  (b)  average:  .15,  and  (c)  low:  -.17.  In  addition,  the  indi¬ 
vidual  and  total  scale  coefficients  are  generally  in  the  .17  to  .72  range, 
although  most  coefficients  are  below  .60.  Several  of  the  correlations  were 
significant  at  the  £  <  .05.,  £  <  .01.,  and/or  £  <  .001.  level  of  significance. 

While  the  Student  Self-Ratings  are  highly  reliable  measures  in  terms  of 
internal  consistency  and  stability,  they  have  a  low  to  moderate  relationship  or 
agreement  with  the  Performance  Test.  The  data  suggest  that  the  Student 
Self-Ratings  are  probably  detecting  student  characteristics  or  variables  other 
than  vocational  programs,  gender,  or  level  of  mathematics  aptitude.  For 
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example,  the  Student  Self-Ratings  may  reflect,  in  some  cases,  students' 
self-esteem  or  self-image.  Therefore,  some  students  may  be  underestimating 
their  skills  while  other  students  may  be  overestimating  their  skills  relative  to 
their  scores  on  the  Performance  Test.  The  Student  Self-Ratings  may  also  be 
detecting  other  similar  psychological  variables.  Therefore,  when  using  the 
Student  Self-Ratings,  school  personnel  should  be  aware  that  an  individual 
student's  ratings  may  be  somewhat  higher  or  lower  than  his/her  actual  score 
on  the  Performance  Test. 

Administration 

A  brief  explanation  by  the  teacher  or  other  appropriate  school  personnel 
as  to  the  purpose  of  the  Student  Self-Ratings  assessment  instrument,  may 
help  the  student  to  maintain  interest  and  motivation  for  completing  the 
Ratings.  The  Ratings  may  be  administered  to  individual  students  or  to  a 
group  of  students. 

Each  student  is  provided  a  Student  Self-Ratings  instrument  that  includes 
directions  and  an  example  for  completing  the  Ratings.  On  the  first  page  of 
the  Ratings,  the  student  should  write  his/her  name,  write  his/her  teacher's 
name,  write  the  name  of  his/her  school,  check  (^/)  his/her  vocational  program 
area,  and  write  the  name  of  his/her  vocational  program.  Students  are  then 
directed  to  "Indicate,  by  circling  the  number,  how  well  you  believe  you  can 

do  each  of  the  following  mathematics  skills."  It  is  important  that  students 

understand  they  are  only  to  rate  how  well  they  believe  they  can  do  each  of 

the  skills,  and  not  to  actually  "perform"  the  skills.  At  the  end  of  the 

Ratings,  in  the  spaces  provided,  students  may  also  write  comments  about 
their  mathematics  skills. 

Students  should  be  permitted  as  much  time  as  is  necessary  to  complete 
the  Student  Self-Ratings.  The  administrator  (e.g.,  teacher,  counselor)  of 
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the  Ratings  may  decide  to  stop  the  assessment  at  a  logical  point  (e.g.,  at  the 
end  of  a  scale)  and  continue  at  a  later  time.  Students  should  understand 
that  the  results  of  the  Student  Self-Ratings  instrument  will  not  affect  their 
admission  to  or  participation  in  a  vocational  program  or  class. 

Scoring 

The  Generalizable  Mathematics  Skills  Assessment  Student  Self-Ratings 
instrument  may  be  scored  and  the  results  interpreted  for  individual  skills,  for 
scales,  and/or  for  the  total  instrument  ( i . e . ,  all  7  scales  and  28  skills). 

Individual  Skills 

If  the  ratings  are  interpreted  for  each  individual  skill,  each  descriptor 
(i.e.,  "Cannot  Do,"  "Cannot  Do  Too  Well,"  "Can  Do  Fairly  Well,"  "Can  Do 
Well")  may  describe  a  student's  self-reported  skill  level.  For  example,  a 
rating  of  "4"  or  "Can  Do  Well"  on  a  specific  skill,  may  indicate  a  high  level  of 
skill  proficiency-assuming  no  overestimation-- (see  pages  31  and  32)  for  an 
individual  student;  thus,  no  major  learning  problem  may  exist,  and  specific 
learning  prescriptions  (e.g.,  additional  instruction)  or  support  services  may 
not  be  necessary.  Conversely,  a  rating  of  "1"  or  "Cannot  Do"  may  likely 
suggest  that  a  low  skill  level  exists--assuming  no  underestimation--(see  page 
32)  and  that  learning  prescriptions  including  remedial  or  support  services  are 
probably  needed  for  an  individual  student. 

A  rating  of  "2"  or  "Cannot  Do  Too  Well"  may  indicate  that  perhaps  some 
(i.e.,  average)  skill  proficiency  is  present  but  the  student  may  encounter 
problems  at  different  stages  of  making  calculations  or  solving  word  problems. 
In  such  cases,  the  learning  prescription  needs  to  focus  on  those  specific 
areas  in  which  students  are  having  difficulty  and  correct  them  accordingly. 
A  rating  of  "3"  or  "Can  Do  Fairly  Well"  (i.e.,  average  skill  proficiency)  most 
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likely  indicates  that  in  many  situations  a  student  can  perform  a  skill  but  may 
have  difficulty  at  times  during  different  stages  of  making  calculations  and 
problem  solving.  Similarly,  a  learning  prescription  should  focus  on  those 
areas  causing  some  difficulty  for  students.  Scoring  and  interpreting  indi¬ 
vidual  skills  probably  is  most  useful  for  diagnosing  specific  functional  learn¬ 
ing  problems,  and  for  subsequently  prescribing  the  needed  support  services 
or  additional  work  necessary  for  attaining  increased  skill  proficiency. 

Scales  and  Total  Instrument 

The  Student  Self-Ratings  may  also  be  scored  and  interpreted  by  indi¬ 
vidual  scales  or  by  the  total  instrument.  An  overall  indication  of  skill  pro¬ 
ficiency  can  be  obtained  and  may  include:  (a)  1-1.99  average  rating;  low 
skill  proficiency,  (b)  2.00-2.99  average  rating;  average  skill  proficiency,  and 
(c)  3.00-4.00  average  rating;  high  skill  proficiency.  For  example,  a  3.5 
average  skill  rating  on  a  scale  (e.g.,  whole  numbers  scale,  skills  1-5)  or  the 
total  instrument  (all  7  scales  and  28  skills)  may  indicate  a  moderately  high 
self-report  of  skill  proficiency.  Minimal,  if  any,  additional  instructional  or 
support  services  may  be  needed  for  an  individual  student  to  attain  the  mathe¬ 
matics  skills  required  for  success  in  his/her  vocational  program.  An  average 
skill  rating  of  1.5,  however,  probably  would  suggest  that  additional  instruc¬ 
tion,  remedial,  and/or  support  services  are  necessary  for  assisting  a  student 
to  attain  the  required  skill  levels. 

It  should  also  be  noted  again  that  an  individual  student's  Self-Ratings  on 
specific  skills  and  scales,  or  the  total  instrument,  may  be  somewhat  over¬ 
estimated  or  underestimated  relative  to  his/her  score  on  the  Generalizable 
Mathematics  Skills  Performance  Test.  However,  as  students  use  the  Student 
Self-Ratings  more  frequently,  they  should  become  increasingly  familiar  with 
the  mathematics  skills  requirements  of  their  vocational  programs.  In  addition, 
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using  the  Student  Self-Ratings  should  allow  students  to  become  more  knowl¬ 
edgeable  about  their  learning  strengths  and  functional  learning  problems,  and 
become  self-directed  in  the  assessment  and  learning  process.  Further,  for 
students  who  underestimate  or  overestimate  their  generalizable  mathematics 
skills,  use  of  the  Student  Self-Ratings  should  assist  their  self-reports  to 
become  consistent  with  their  actual  performance  (scores). 

The  teacher  may  use  the  "Skill  Profile"  provided  with  the  Student  Self- 
Ratings  instrument  (see  Appendix  C).  The  Ratings  may  be  transferred  from 
the  instrument  to  the  "Skill  Profile"  when  developing  and  maintaining  progress 
reports/records  for  students.  The  "Skill  Profile"  may  serve  as  a  reference 
useful  in  individualized  instructional  planning. 

Uses 

The  Generalizable  Mathematics  Skills  Assessment  Student  Self-Ratings 
instrument,  as  stated  previously,  has  potential  for  allowing  students  to 
become  more  familiar  with  the  mathematics  skills  requirements  of  their  pro¬ 
grams  and  become  more  cognizant  of  their  learning  strengths  and  functional 
learning  problems.  The  Ratings  could  also  assist  students  to  become  more 
self-directed  in  the  learning  and  decision-making  processes.  The  Student 
Self-Ratings  could,  therefore,  be  useful  throughout  a  student's  vocational 
course  or  program. 

The  Student  Self-Ratings  could  be  administered  during  the  first  week  of 
classes  (daily  if  necessary)  and  every  week  (formative  assessment)  there¬ 
after,  as  well  as  at  the  end  of  the  course  or  program  to  provide  summative 
information  about  student  skill  proficiencies.  Teachers  or  other  school  per¬ 
sonnel  should  plan  for  and  use  the  Self-Ratings  as  frequently  as  necessary, 
based  on  individual  student  needs. 
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The  information  and  interpretation  of  the  Ratings  should  be  helpful  not 
only  in  assessment  activities  but  also  for  instructional  planning,  curriculum 
development,  instructional  delivery,  and  evaluation.  For  example,  the  infor¬ 
mation  obtained  on  individual  students  may  assist  in  developing  individualized 
vocational/career  plans.  The  assessment  information  obtained  can  help  in 
writing  instructional  objectives,  planning  activities,  and  designing  appropriate 
evaluation  methods.  Based  on  the  assessment  data  obtained,  the  teacher  can 
develop  curriculum  by  identifying  those  necessary  generalizable  mathematics 
skills  that  need  to  be  taught  through  infusion  in  vocational  instruction, 
separate  courses,  or  remedial  and  support  services.  The  teacher  may  also 
use  the  Student  Self-Ratings  assessment  information  for  revising,  modifying, 
or  improving  his/her  instructional  delivery  techniques  for  individual  students. 

The  teacher  may  choose  between  or  use  a  combination  of  the  Student 
Self-Ratings,  Teacher  Ratings,  and  Performance  Test  for  assessing  a  stu¬ 
dent's  generalizable  mathematics  skill  levels.  Each  instrument,  which  is 
designed  to  measure  the  same  generalizable  mathematics  skills,  provides 
unique  input  about  student  skill  proficiencies  by  using  different  strategies. 

In  summary,  the  Student  Self-Ratings  have  several  uses  which  may 
include: 

•  Creating  an  awareness  in  the  student  of  the  mathematics  skills  require¬ 

ments  of  his/her  vocational  program. 

•  Permitting  the  student  to  become  actively  involved  in  the  assessment 

process. 

•  Providing  formative  and  summative  assessment  information  about  a  stu¬ 

dent's  learning  strengths  and  functional  learning  problems. 

•  Assisting  the  student  in  becoming  self-directed  in  the  learning  and 

decision-making  processes. 

•  Aiding  in  instructional  planning,  curriculum  development,  instructional 

delivery,  and  evaluation  activities. 


-13- 


career  pr 


Teacher  Ratings 


Instrument  Development 

The  purpose  of  the  Generalizable  Mathematics  Skills  Teacher  Ratings 
Assessment  instrument  (See  Appendix  D)  is  to  assess  how  well  teachors  can 
perceive  or  estimate  their  students'  generalizable  mathematics  skills.  The 
same  scales,  skills,  items,  and  procedures  used  to  develop  the  Student  Self- 
Ratings  instrument  were  used  to  develop  the  Teacher  Ratings  instrument. 
The  format  and  content  of  the  Teacher  Ratings  were  identical  to  the  Student 
Self-Ratings,  except  for  the  directions  which  were  directed  toward  teachers. 

Several  drafts  of  the  Teacher  Ratings  were  developed  and  reviewed  by  a 
panel  of  experts  which  included  teachers,  administrators ,  teacher  educators, 
and  researchers.  The  panel's  input  regarding  content,  design,  meaning, 
clarity,  and  readability  was  used  in  producing  the  revisions  of  the  Teacher 
Ratings  instrument.  The  instrument  was  also  pilot  tested  on  a  random  sample 
of  teachers  in  selected  secondary  vocational  programs.  Based  on  the  collec¬ 
tive  feedback  from  the  panel  of  experts  and  information/data  from  the  pilot 
testing,  the  final  version  of  the  Generalizable  Mathematics  Skills  Teacher 
Ratings  was  produced.  The  Teacher  Ratings  was  then  considered  to  possess 
a  sufficient  degree  of  content  and  face  validity.  Extensive  field  testing  was 
conducted  to  estimate  the  reliability  and  further  validate  the  Teacher  Ratings. 

Reliability 

Internal  Consistency  Reliability 

The  internal  consistency  reliability  of  the  total  Teacher  Ratings  instru¬ 
ment  is  .99  (Cronbach's  Coefficient  Alpha).  This  value  indicates  that  the 
instrument  is  highly  internally  consistent  and  is  measuring  a  uniform  or  single 
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construct  of  generalizable  mathematics  skills.  For  15  vocational  programs  the 
reliability  coefficients  range  from  .97  to  1.00.  The  coefficients  for  males  and 
for  females  is  .99.  The  Teacher  Ratings  are  also  highly  internally  consistent 
for  students  with  different  levels  of  mathematics  aptitude  as  measured  by  the 
Generalizable  Mathematics  Skills  Performance  Test  (high:  .98,  average:  .98, 
low:  .99).  In  addition,  the  individual  and  total  coefficients  were  generally 

in  the  .90  to  1.00  range.  The  data  indicate  that  the  Generalizable  Mathe¬ 
matics  Skills  Teacher  Ratings  Assessment  instrument  possesses  high  internal 
consistency  and  is  a  reliable  measure  for  different  vocational  programs,  males 
and  females,  and  students  who  have  high,  average,  or  low  mathematics  apti¬ 
tude. 


Test-Retest  Reliability 

The  test-retest  reliability  of  the  total  Teacher  Ratings  instrument  is 
r  =  .83.  This  correlation  indicates  that  the  Teacher  Ratings  instrument 
re-administered  over  time  (14  days)  to  the  same  teachers  is  capable  of  pro¬ 
ducing  stable  measures.  The  test-retest  reliability  coefficients  for  15  voca¬ 
tional  programs  generally  range  from  .44  to  .99.  The  coefficients  for  males  is 
.86  and  for  females  is  .80.  The  Teacher  Ratings  are  also  stable  for  students 
with  different  levels  of  mathematics  aptitude  (high:  .83,  average:  .76,  low: 
.88).  In  addition,  the  individual  and  total  scale  coefficients  are  generally  in 
the  .50  to  1.00  range.  Most  of  the  correlations  are  significant  at  the 
£  <  .05,  ^  <  .01,  and  or  £  <  .001.  level  of  significance.  The  test-retest 
reliability  data  indicate  that  the  Generalizable  Mathematics  Skills  Teacher  Rat¬ 
ings  Assessment  instrument  generally  possesses  an  acceptable  level  of  test- 
retest  reliability  and  is  a  moderate  to  high  stable  measure  for  different  voca¬ 
tional  programs,  males  and  females,  and  students  who  have  high,  average,  or 
low  mathematics  aptitude. 
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Validity 


Construct  Validity 

The  correlation  (r)  between  the  total  Generalizable  Mathematics  Skills 
Teacher  Ratings  and  the  Performance  Test  is  .53.  This  coefficient  indicates 
that  there  is  a  moderate  relationship  or  agreement  between  the  Teacher 
Ratings  and  Performance  Test.  The  correlations  between  the  Teacher  Ratings 
and  Performance  Test  for  15  vocational  programs  range  from  -.21  to  .78. 
The  coefficients  for  males  is  .46  and  for  females  is  .57.  The  correlations  for 
students  with  different  levels  of  mathematics  aptitude  are:  (a)  high  .49,  (b) 
average  .35,  and  (c)  low  -.48.  In  addition,  the  individual  and  total  scale 
coefficients  are  generally  in  the  .27  to  .81  range,  although  most  coefficients 
are  below  .50.  Several  of  the  correlations  were  significant  at  the  ja  <  .05, 
^  <  .01,  and/or  ja  <  .001.  level  of  significance. 

While  the  Teacher  Ratings  are  highly  reliable  measures  in  terms  of  inter¬ 
nal  consistency  and  stability,  they  have  a  low  to  moderate  relationship  or 
agreement  with  the  Performance  Test.  The  data  suggest  that  the  Teacher 
Ratings,  similar  to  the  Student  Self-Ratings,  are  probably  detecting  student 
characteristics  or  variables  other  than  vocational  programs,  gender,  or  level 
of  mathematics  aptitude.  For  example,  some  teachers  may  be  underestimating 
their  students'  skills  while  other  teachers  may  be  overestimating  their  stu¬ 
dents'  skills  relative  to  scores  on  the  Performance  Test.  The  Teacher 
Ratings  may  also  be  detecting  other  psychological  variables.  Therefore,  when 
using  the  Teacher  Ratings,  school  personnel  should  be  aware  that  an  indi¬ 
vidual  teacher's  ratings  of  his/her  students  may  be  somewhat  higher  or  lower 
than  the  students'  actual  scores  on  the  Performance  Test. 
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Administration 


One  Teacher  Ratings  instrument  is  to  be  used  for  each  student  who  is 

being  assessed  at  a  given  time.  The  Teacher  Ratings  include  directions  and 

an  example  for  completing  the  Ratings.  On  the  first  page  of  the  Ratings,  the 
teacher  may  write  his/her  student's  name,  write  his/her  name,  write  the  name 
of  his/her  school,  check  (V)  his/  her  vocational  program  area,  and  write  the 
name  of  his/her  vocational  program.  Teachers  are  then  directed  to  "Indicate, 
by  circling  the  number,  how  well  you  believe  the  student  named  on  the  cover 
sheet  can  do  each  of  the  following  mathematics  skills."  At  the  end  of  the 
Ratings,  in  the  spaces  provided,  teachers  may  also  write  comments  about 
their  students'  mathematics  skills. 

Teachers  should  use  as  much  time  as  is  necessary  to  complete  the 
Ratings  for  each  student.  The  teacher  may  decide  to  stop  the  assessment  at 
a  logical  point  (e.g.,  at  the  end  of  a  scale)  and  continue  at  a  later  time. 

Teachers  should  not  use  the  results  of  the  Teacher  Ratings  instrument  to 

affect  a  student's  admission  to  or  participation  in  a  vocational  program  or 
class . 

Scoring 

The  Generalizable  Mathematics  Skills  Assessment  Teacher  Ratings  instru¬ 
ment,  similar  to  the  Student  Self-Ratings  instrument,  may  be  scored  and  the 
results  interpreted  for  individual  skills,  for  scales,  and/or  for  the  total 
instrument  (i.e.,  all  7  scales  and  28  skills). 

Individual  Skills 

If  the  Ratings  are  interpreted  for  each  individual  skill,  each  descriptor 
(i.e.,  "Cannot  Do,"  Cannot  Do  Too  Well,"  "Can  Do  Fairly  Well,"  "Can  Do 
Well")  may  describe  a  teacher's  report  of  a  student's  skill  level.  For 
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example,  a  rating  of  "4"  or  "Can  Do  Well"  on  a  specific  skill  may  indicate  a 
high  level  of  skill  proficiency--assuming  no  overestimation--(see  pages  31  and 
32)  for  an  individual  student.  Thus,  no  major  learning  problem  may  exist, 
and  specific  learning  prescriptions  (e.g.,  additional  instruction)  or  support 
services  may  not  be  necessary.  Conversely,  a  rating  of  "1"  or  "Cannot  Do" 
may  likely  suggest  that  a  iow  skill  level  exists  (assuming  no  under¬ 
estimation;  see  page  32)  and  that  learning  prescriptions  including  remedial  or 
support  services  are  probably  needed  for  an  individual  student. 

A  rating  of  "2"  or  "Cannot  Do  Too  Well"  may  indicate  that  perhaps  some 
( i .  e . ,  average)  skill  proficiency  is  present  but  the  student  may  encounter 
problems  at  different  stages  of  making  calculations  or  solving  word  problems. 
In  such  cases,  the  learning  prescription  needs  to  focus  on  those  specific 
areas  in  which  students  are  having  difficulty  and  correct  them  accordingly. 
A  rating  of  "3"  or  "Can  Do  Fairly  Well"  (i.e.,  average  skill  proficiency)  most 
likely  indicates  that  in  many  situations  a  student  can  perform  a  skill  but  may 
have  difficulty  at  times  during  different  stages  of  making  calculations  and 
problem  solving.  Similarly,  a  learning  prescription  should  focus  on  those 
areas  causing  some  difficulty  for  students.  Scoring  and  interpreting  indi¬ 
vidual  skills  probably  is  most  useful  for  diagnosing  specific  functional  learn¬ 
ing  problems,  and  for  subsequently  prescribing  the  needed  support  services 
or  additional  work  necessary  for  attaining  increased  skill  proficiency. 

Scales  and  Total  Instrument 

The  Teacher  Ratings  may  also  be  scored  and  interpreted  by  individual 
scales  or  by  the  total  instrument.  An  overall  indication  of  skill  proficiency 
can  be  obtained  and  may  include:  (a)  1-1.99  average  rating;  low  skill  pro¬ 
ficiency,  (b)  2.00-2.99  average  rating;  average  skill  proficiency,  and  (c) 
3.00-4.00  average  rating;  high  skill  proficiency.  For  example,  a  3.5  average 
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skill  rating  on  a  scale  (e.g.,  whole  numbers  scale,  skills  1-5)  or  the  total 
instrument  (all  7  scales  and  28  skills)  may  indicate  a  moderately  high  report 
of  skill  proficiency.  Minimal,  if  any,  additional  instructional  or  support 
services  may  be  needed  for  an  individual  student  to  attain  the  mathematics 
skills  required  for  success  in  his/her  vocational  program.  An  average  skill 
rating  of  1.5,  however,  probably  would  suggest  that  additional  instruction, 
remedial,  and/or  support  services  are  necessary  for  assisting  a  student  to 
attain  required  skill  levels. 

It  should  also  be  noted  again  that  an  individual  teacher's  ratings  on 
specific  skills  and  scales,  or  the  total  instrument,  may  be  somewhat  over¬ 
estimated  or  underestimated  relative  to  his/her  students'  scores  on  the 
Generalizable  Mathematics  Skills  Performance  Test.  However,  as  teachers  use 
the  Teacher  Ratings  more  frequently,  they  should  become  more  knowledgeable 
about  their  students'  learning  strengths  and  functional  learning  problems. 
Further,  for  teachers  who  underestimate  or  overestimate  their  students' 
generalizable  mathematics  skills,  use  of  the  Teacher  Ratings  should  assist 
their  reports  to  become  consistent  with  their  students'  actual  performance 
(scores) . 

The  teacher  may  use  the  "Skill  Profile"  provided  with  the  Teacher 
Ratings  instrument  (see  Appendix  D).  The  Ratings  may  be  transferred  from 
the  instrument  to  the  "Skill  Profile"  when  developing  and  maintaining  progress 
reports/records  for  students.  The  "Skill  Profile"  may  serve  as  a  reference 
useful  in  individualized  instructional  planning. 

Uses 

The  Generalizable  Mathematics  Skills  Assessment  Teacher  Ratings  instru¬ 
ment,  as  stated  previously,  has  potential  for  allowing  teachers  to  become  more 
familiar  with  the  learning  strengths  and  functional  learning  problems  of  stu- 
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dents  in  their  vocational  programs.  The  Teacher  Ratings  could,  therefore, 
be  useful  throughout  a  student's  vocational  course  or  program. 

The  Teacher  Ratings  could  be  administered  during  the  first  week  of 
classes  (daily  if  necessary)  and  every  week  (formative  assessment)  there¬ 
after,  as  well  as  at  the  end  of  the  course  or  program  to  provide  summative 
information  about  student  skill  proficiencies.  Teachers  or  other  school  per¬ 
sonnel  should  plan  for  and  use  the  Teacher  Ratings  as  frequently  as  neces¬ 
sary,  based  on  individual  student  needs. 

The  information  and  interpretation  of  the  Ratings  should  be  helpful  not 
only  in  assessment  activities  but  also  for  instructional  planning,  curriculum 
development,  instructional  delivery,  and  evaluation.  For  example,  the  infor¬ 
mation  obtained  on  individual  students  may  assist  in  developing  individualized 
vocational/career  plans.  The  assessment  information  obtained  can  help  in 
writing  instructional  objectives,  planning  activities,  and  designing  appropriate 
evaluation  methods.  Based  on  the  assessment  data  obtained,  the  teacher  can 
develop  curriculum  by  identifying  those  necessary  generalizable  mathematics 
skills  that  need  to  be  taught  through  infusion  in  vocational  instruction, 
separate  courses,  or  remedial  and  support  services.  The  teacher  may  also 
use  the  Student  Self-Ratings  Assessment  information  for  revising,  modifying, 
or  improving  his/her  instructional  delivery  techniques  for  individual  students. 

The  teacher  may  choose  between  or  use  a  combination  of  the  Teacher 
Ratings,  Student  Self-Ratings,  and  Performance  Test  for  assessing  a  stu¬ 
dent's  generalizable  mathematics  skill  levels.  Each  instrument,  which  is 
designed  to  measure  the  same  generalizable  mathematics  skills,  provides 
unique  input  about  student  skill  proficiencies  by  using  different  strategies. 

In  summary,  the  Teacher  Ratings  have  several  uses  which  may  include: 
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•  Creating  an  increased  awareness  in  the  teacher  of  the  mathematics  skills 

requirements  of  his/her  vocational  program. 


•  Permitting  the  teacher  to  become  more  directly  involved  in  the  assess¬ 

ment  process. 

•  Providing  formative  and  summative  assessment  information  about  a  stu¬ 

dent's  learning  strengths  and  functional  learning  problems. 

•  Aiding  in  instructional  planning/  curriculum  development,  instructional 

delivery;  and  evaluation  activities. 

•  Providing  information  useful  for  developing  individualized  vocational/ 

career  programs. 
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Performance  Test 


Instrument  Development 

The  purpose  of  the  Generalizable  Mathematics  Skills  Performance  Test 
Assessment  instrument  (See  Appendix  E)  is  to  assess  how  well  students  can 
perform  generalizable  mathematics  skills  as  measured  by  a  performance  test. 
The  same  scales,  skills,  items,  and  procedures  used  to  develop  the  Student 
Self-Ratings  and  Teacher  Ratings  instruments  were  used  to  develop  the 
Performance  Test  instrument.  However,  the  design,  format,  and  nature  of 
the  item  content  was  different  from  the  Student  Self-Ratings  and  Teacher 
Ratings . 

Each  of  the  generalizable  mathematics  skills  were  translated  into  7  scales 
and  150  instrument  items  and  included:  (a)  Whole  Numbers  Scale  (25  items), 
(b)  Fractions  Scale  (34  items),  (c)  Decimals  Scale  (43  items),  (d)  Percent 
Scale  (9  items),  (e)  Mixed  Operations  Scale  (15  items),  (f)  Measurement  and 
Calculation  Scale  (20  items)  and  (g)  Estimation  Scale  (4  items).  A  three- 
distractor  multiple-choice  format  is  used  to  measure  each  skill.  Directions 
and  an  example  are  provided  to  assist  students  in  using  the  instrument. 

Several  drafts  of  the  Performance  Test  were  developed  and  reviewed  by 
a  panel  of  experts  which  included  teachers,  students,  administrators,  teacher 
educators,  and  researchers.  The  panel's  input  regarding  content,  design, 
meaning,  clarity,  and  readability  was  used  in  producing  the  revisions  of  the 
Performance  Test.  The  instrument  was  also  pilot  tested  on  a  random  sample 
of  students  in  selected  vocational  programs.  Based  on  the  collective  feedback 
from  the  panel  of  experts  and  information/data  from  the  pilot  testing,  the 
final  version  of  the  Generalizable  Mathematics  Skills  Performance  Test  Assess¬ 
ment  instrument  was  produced.  The  performance  test  was  then  considered  to 
possess  a  sufficient  degree  of  content  and  face  validity.  Extensive  field 
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testing  was  conducted  to  estimate  the  reliability  and  further  validate  the 
Performance  Test.  The  Performance  Test  Answer  Keyis  provided  in  Appendix  F. 

Item  Analysis 

After  extensive  field  testing,  an  item  analysis  was  conducted  on  the 
Performance  Test.  The  major  purpose  of  the  item  analysis  was  to  examine 
each  of  the  150  items  for  their  degrees  of  difficulty  and  discrimination  ability. 
Item  difficulty  is  based  on  how  many  persons  answer  an  item  correctly. 
Therefore,  if  most  persons  respond  correctly  to  a  particular  item,  that  item 
would  be  considered  an  "easy  item."  Conversely,  if  few  people  answer  an 
item  correctly,  that  item  would  be  considered  a  "difficult  item."  If  approxi¬ 
mately  one-half  of  all  the  persons  taking  a  test  answer  an  item  correctly  and 
one-half  incorrectly,  that  item  would  be  considered  moderately  easy  or  diffi¬ 
cult. 

Item  discrimination  indicates  the  extent  to  which  a  particular  item  "dis¬ 
criminates"  between  those  persons  who  score  in  the  upper  50%  of  scores  and 
those  persons  who  score  in  the  lower  50%  of  scores.  If  an  item  discriminates 
well,  those  persons  who  scored  in  the  upper  50%  should  answer  the  item 
correctly,  and  those  who  score  in  the  lower  50%  should  answer  the  item  in¬ 
correctly.  If  an  item  does  not  discriminate  well,  the  reverse  is  true.  There¬ 
fore,  for  each  item,  the  key  (right  answer)  should  discriminate  positively, 
and  each  distractor  (wrong  answer)  should  discriminate  negatively.  In  addi¬ 
tion,  each  distractor  should  have  at  least  some  responses. 

The  item  analysis  was  conducted  on  the  Performance  Test  for  all  stu¬ 
dents,  each  of  15  vocational  programs,  males  and  females,  and  students  who 
have  high,  average,  and  low  levels  of  mathematics  aptitude.  The  analysis 
indicates  that  the  Performance  Test  is  moderately  difficult  and  discriminates 
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well  between  those  students  who  score  high  and  those  students  who  score 
low.  In  addition,  the  key  and  three  (3)  distractors  for  each  of  the  150  items 
were  checked  for  (a)  miskeying  (wrong  answer),  (b)  guessing,  and  (c)  ambi¬ 
guity.  The  information  obtained  from  the  item  analysis  was  used  to  revise 
individual  items  in  the  Performance  Test.  Individual  items  (stems,  keys,  and 
distractors)  were  revised  as  needed.  The  Performance  Test  was  then  con¬ 
sidered  to  possess  a  high  degree  of  content  and  face  validity. 

Reliability 

Internal  Consistency  Reliability 

The  internal  consistency  reliability  of  the  total  Performance  Test  is  .97 
(Kuder-Richardson  -21  (KR-21)).  This  value  indicates  that  the  instrument  is 
very  highly  internally  consistent  and  is  measuring  a  uniform  or  single  con¬ 
struct  of  generalizable  mathematics  skills.  The  standard  error  of  measurement 
(SEM)  for  the  total  instrument  is  4.73.  The  SEM  means  that  a  person's  true 
score  on  the  Performance  Test  will  be  +  4.73  points  from  his/her  obtained 
score  68%  of  the  time.  A  person's  true  score  will  be  +  9.46  (2  SEMs)  points 
from  his/her  obtained  score  95%  of  the  time,  or  +  14.19  (3  SEMs)  points  99% 
of  the  time.  For  15  vocational  programs  the  reliability  coefficients  range  from 
.90  to  .98  and  the  SEM  ranges  from  3.78  to  4.86.  The  coefficients  for  males 
and  females  are  .99,  and  the  SEM  is  3.97  and  4.02,  respectively.  The  Per¬ 
formance  Test  is  also  highly  internally  consistent  for  students  with  different 
levels  of  mathematics  aptitude  as  measured  by  the  Performance  Test  (high: 
.97,  average:  .96,  low:  .95)  and  the  SEMs  are  4.32,  4.45  and  4.16,  respec¬ 
tively.  The  data  indicate  that  the  Generalizable  Mathematics  Skills  Perfor¬ 
mance  Test  Assessment  instrument  possesses  high  internal  consistency  and  is 
a  reliable  measure  for  different  vocational  programs,  males  and  females,  and 
students  who  have  high,  average,  and  low  mathematics  aptitude. 
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Test-Retest  Reliability 

The  test-retest  reliability  of  the  total  Performance  Test  instrument  is 
r  =  .65.  This  correlation  is  significant  at  the  .001  level  of  significance  and 
indicates  that  the  Performance  Test  re-administered  over  time  (14  days)  to 
the  same  students  produces  similar  results,  and  is,  therefore  capable  of 
producing  stable  measures.  The  test-retest  reliability  coefficients  for  15 
vocational  programs  generally  range  from  .53  to  .99  with  most  correlations 
above  .85.  The  coefficients  for  males  is  .44  and  for  females  is  .79.  The 
correlations  for  students  with  different  levels  of  mathematics  aptitude  are 
high:  .85,  average:  .50,  low:  -.26.  In  addition,  the  individual  and  total 

scale  coefficients  are  generally  in  the  .40  to  .99  range  with  most  coefficients 
above  .60.  Most  of  the  correlations  are  significant  at  the  £  <  .05., 
£  <  .01.,  and/or  £  <  .001  level  of  significance.  The  test-retest  reliability 
data  indicate  that  the  Generalizable  Mathematics  Skills  Performance  Test 
Assessment  instrument  generally  possesses  an  acceptable  level  of  test-retest 
reliability  and  is  a  moderate  to  high  stable  measure  for  different  vocational 
programs,  males  and  females,  and  students  who  have  high,  average,  and  low 
mathematics  aptitude. 

Validity 

Construct  Validity 

The  relationship  or  extent  of  agreement  between  the  Student  Self-Ratings 
or  Teacher  Ratings  with  the  Performance  Test,  as  measured  by  correlation, 
was  low  to  moderate.  The  correlations  between  the  Student  Self-Ratings  and 
the  Performance  Test  range  from  .17  to  .72,  although  most  coefficients  are 
below  .60.  The  correlations  between  the  Teacher  Ratings  and  the  Perfor¬ 
mance  Test  range  from  .27  to  .81,  although  most  coefficients  are  below  .50. 
While  the  Student  Self-Ratings,  Teacher  Ratings,  and  Performance  Test  are 
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highly  reliable  measures,  the  Student  Self-Ratings  and  Teacher  Ratings  are 
probably  detecting  psychological  variables  not  detected  by  the  Performance 
Test.  The  scores  on  the  Student  Self-Ratings  and  Teacher  Ratings,  there¬ 
fore,  may  be  somewhat  higher  or  lower  than  Performance  Test  scores  for 
individual  students. 

Administration 

The  Performance  Test  includes  directions  and  an  example  for  completing 
the  Test.  On  the  first  page  of  the  Ratings,  the  student  may  write  his/her 
name,  write  his/her  teacher's  name,  write  the  name  of  his/her  school,  check 
(V)  his/her  vocational  program  area,  and  write  the  name  of  his/her  vocational 
program.  Students  are  then  directed  to  "Do  each  of  the  following  problems 
by  circling  the  correct  answer.  Please  use  the  scratch  paper  provided  to 
work  out  your  answers." 

Students  should  be  permitted  as  much  time  as  is  necessary  to  complete 
the  Performance  Test.  The  administrator  (e.g.,  teacher,  counselor)  of  the 
Test  may  decide  to  stop  the  assessment  at  a  logical  point  (i.e.,  at  the  end  of 
a  scale)  and  continue  at  a  later  time.  Students  should  understand  that  the 
results  of  the  Performance  Test  instrument  will  not  affect  their  admission  to 
or  participation  in  a  vocational  program  or  class. 

Scoring 

The  Generalizable  Mathematics  Skills  Assessment  Performance  Test  instru¬ 
ment  may  be  scored  and  the  results  interpreted  for  individual  skills,  for 
scales,  and/or  for  the  total  instrument  (i.e.,  all  7  scales  and  28  skills). 

Individual  Skills 

If  the  items  are  interpreted  for  each  skill,  correct  or  incorrect 
responses  provide  an  indication  of  skill  proficiency.  For  example,  a  correct 
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response  on  a  particular  item  may  indicate  skill  proficiency  for  an  individual 
student.  Thus,  no  major  learning  problem  may  exist,  and  specific  learning 
prescriptions  (e.g.,  additional  instruction)  or  support  services  may  not  be 
necessary.  Conversely,  a  wrong  answer  on  a  particular  item  indicates  a  lack 
of  skill  proficiency  and  that  learning  prescriptions  including  remedial  or 
support  services  are  probably  needed  for  an  individual  student.  A  wrong 
answer  may  also  suggest  that  some  skill  proficiency  is  present  but  the  stu¬ 
dent  may  encounter  problems  at  different  stages  of  making  calculations  or 
solving  word  problems.  In  such  cases,  the  learning  prescription  needs  to 
focus  on  those  specific  areas  in  which  students  are  having  difficulty  and 
correct  them  accordingly.  Scoring  and  interpreting  individual  skills  is  prob¬ 
ably  most  useful  for  diagnosing  specific  functional  learning  problems,  and  for 
subsequently  prescribing  the  needed  support  services  or  additional  work 
necessary  for  attaining  increased  skill  proficiency. 

Scales  and  Total  Instrument 

The  Performance  Test  also  may  be  scored  and  interpreted  by  individual 
scales  or  by  the  total  instrument.  An  overall  indication  of  skill  proficiency 
can  be  obtained  based  on  raw  scores  on  the  total  instrument  and  may  include: 
(a)  0-50;  low  skill  proficiency,  (b)  51-100;  average  skill  proficiency,  and  (c) 
101-150;  high  skill  proficiency.  For  example,  a  raw  score  of  38  on  the  total 
instrument  (all  7  scales  and  150  items)  indicates  a  low  skill  proficiency  for  a 
student.  Likewise,  students  who  obtain  raw  scores  of  75  and  140  would  be 
considered  to  have  average  and  high  skill  proficiency,  respectively.  A  score 
of  140  on  the  total  instrument  probably  indicates  that  minimal,  if  any,  addi¬ 
tional  instructional  or  support  services  are  needed  for  an  individual  student 
to  attain  the  mathematics  skills  required  for  success  in  his/her  vocational 
program.  However,  a  score  of  75  (average  skill  proficiency)  or  38  (low  skill 
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proficiency)  strongly  suggests  that  additional  instruction  and  remedial  or 
support  services  are  necessary  for  assisting  a  student  to  attain  the  required 
skill  levels. 

The  Performance  Test  may  be  scored  and  results  interpreted  by  indi¬ 
vidual  scales  using  similar  procedures  used  for  the  total  instrument  (see 
Table  1).  For  example,  the  whole  numbers  scale  includes  25  items  involving 
different  kinds  of  skills.  Raw  scores  of  1-8,  9-17,  and  18-25  may  be  inter¬ 
preted  as  low,  average,  and  high  skill  proficiencies  for  individual  students, 
respectively.  The  teacher  should  focus  on  those  items  the  student  answers 
incorrectly  and  prescribe  the  necessary  additional  instruction  and  remedial  or 
support  services,  accordingly. 

The  teacher  may  use  the  "Skill  Profile"  provided  with  the  Performance 
Test  instrument  (See  Appendix  E).  The  Test  scores  may  be  transferred  from 
the  instrument  to  the  "Skill  Profile"  when  developing  and  maintaining  progress 
reports/records  for  students.  The  "Skill  Profile"  may  serve  as  a  reference 
useful  in  individualized  instructional  planning. 

Uses 

The  Generalizable  Mathematics  Skills  Assessment  Performance  Test 
Instrument  has  potential  for  allowing  students  to  become  more  familiar  with 
the  mathematics  skills  requirements  of  their  programs  and  become  more  cog¬ 
nizant  of  their  learning  strengths  and  functional  learning  problems.  The 
Performance  Test  could  be  useful  throughout  a  student's  vocational  course  or 
program . 

The  Performance  Test  could  be  administered  during  the  first  week  of 
classes  (daily  if  necessary)  and  every  week  (formative  assessment)  there¬ 
after,  as  well  as  at  the  end  of  the  course  or  program  to  provide  summative 
information  about  student  skill  proficiencies.  Teachers  or  other  school  per- 
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sonnel  should  plan  for  and  use  the  Performance  Test  as  frequently  as  neces¬ 
sary,  based  on  individual  student  needs. 

The  information  and  interpretation  of  the  Performance  Test  information 
should  be  helpful  not  only  in  assessment  activities  but  also  for  instructional 
planning,  curriculum  development,  instructional  delivery,  and  evaluation.  For 
example,  the  information  obtained  on  individual  students  may  assist  in  devel¬ 
oping  individualized  vocational/career  plans.  The  assessment  information 
obtained  can  help  in  writing  instructional  objectives,  planning  activities,  and 
designing  appropriate  evaluation  methods.  Based  on  the  assessment  data 
obtained,  the  teacher  can  develop  curriculum  by  identifying  those  necessary 
generalizable  mathematics  skills  that  need  to  be  taught  through  infusion  in 
vocational  instruction,  separate  courses,  or  remedial  and  support  services. 
The  teacher  may  also  use  the  Performance  Test  assessment  information  for 
revising,  modifying,  or  improving  his/her  instructional  delivery  techniques 
for  individual  students. 

The  teacher  may  choose  between  or  use  a  combination  of  the  Performance 
Test,  Student  Self-Ratings,  and  Teacher  Ratings  for  assessing  a  student's 
generalizable  mathematics  skill  levels.  Each  instrument,  which  is  designed  to 
measure  the  same  generalizable  mathematics  skills  provides  unique  input  about 
student  skill  proficiencies  by  using  different  strategies. 

In  summary,  the  Performance  Test  has  several  uses  which  may  include: 

*  Creating  an  awareness  in  students  and  teachers  of  the  mathematics  skills 

requirements  of  their  vocational  programs. 

*  Providing  formative  and  summative  assessment  information  about  a  stu¬ 

dent's  learning  strengths  and  functional  learning  problems. 

•  Aiding  in  instructional  planning,  curriculum  development,  instructional 

delivery,  and  evaluation  activities. 

•  Providing  information  useful  for  developing  individualized  vocational/ 

career  programs. 
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Use  of  the  Student  Self-Ratings  and  Teacher  Ratings 
With  the  Performance  Test  Assessment  Instrument 


The  previous  sections  discussed  the  development,  reliability,  validity, 
administration,  scoring,  and  uses  of  the  Student  Self-Ratings,  Teacher 
Ratings,  and  Performance  Test  Assessment  instruments.  The  instruments 
have  similar  and  unique  uses  and  are  designed  to  measure  the  same  gen- 
eralizable  mathematics  skills  using  different  strategies  and  procedures.  This 
section  discusses  how  the  teacher  or  other  school  personnel  may  use  the 
instruments  and  how  the  scores  may  be  used  and  interpreted.  The  uses  are 
described  for  individual  skills,  scales,  and  the  total  instruments. 

The  teacher  should  examine  the  color  charts  in  Appendix  B  when  assess¬ 
ing  his/her  students'  mathematics  skills  by  identifying  their  own  programs 
and  those  skills  which  have  high  generalizability  (blue),  medium  generaliz- 
ability  (yellow),  and  low  generalizability  (white).  The  skills  illustrated  in 
blue  should  receive  the  most  emphasis  when  using  the  assessment  instru¬ 
ments,  while  planning  curriculum,  and  when  teaching.  The  teacher  may  place 
less  emphasis  on  those  skills  illustrated  in  yellow  and  minimal  emphasis  might 
be  placed  on  those  skills  illustrated  in  white.  Table  1  describes  the  relation¬ 
ship  of  the  skills  listed  on  the  Student  Self-Ratings  and  Teacher  Ratings  with 
the  items  included  on  the  Performance  Test,  It  will  assist  the  teacher  in 
interpreting  the  Ratings  and  scores  on  the  Performance  Test.  The  Ratings 
and  Performance  Test  scores  indicate  students  who  possess  (a)  high  skill 
proficiency,  (b)  average  skill  proficiency,  and  (c)  low  skill  proficiency: 

High  Skill  Proficiency  A  student  possesses  an  adequate  level  of  general- 

izable  mathematics  skills  and  requires  minimal,  if 
any,  additional  instruction  or  support/remedial 
services  necessary  to  succeed  in  his/her  vocational 
program . 
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Average  Skill  Proficiency  A  student  possesses  a  marginally  adequate  level  of 

generalizable  mathematics  skills  and  requires  a 
moderate  amount  of  additional  instruction  and/or 
support/remedial  services  necessary  to  succeed  in 
his/her  vocational  program. 

Low  Skill  Proficiency  A  student  possesses  an  inadequate  level  of  general¬ 
izable  mathematics  skills  and  requires  a  considerable 
amount  of  additional  instruction  and/or  support/ 
remedial  services  to  succeed  in  his/her  vocational 
program . 

The  Student  Self-Ratings  or  Teacher  Ratings  may  be  somewhat  higher  or 
lower  than  the  scores  on  the  Performance  Test  for  individual  students.  The 
Ratings  may  be  either  underestimated,  overestimated,  or  consistent  with  the 
scores  on  the  Performance  Test  and  are  defined  as  follows: 

Underestimation :  When  a  Student  Self-Rating  or  Teacher  Rating  is  at  a 
lower  level  than  a  score  on  the  Performance  Test  (e.g.,  average 
Student  Self-Rating  and  a  high  Performance  Test  score,  low 
Teacher  Rating  and  an  average  Performance  Test  score). 

Overestimation :  When  a  Student  Self-Rating  or  Teacher  Rating  is  at  a 

higher  level  than  a  score  on  the  Performance  Test  (e.g.,  high 
Student  Self-Rating  and  an  average  Performance  Test  score,  aver¬ 
age  Teacher  Rating  and  low  Performance  Test  score). 

Consistent:  When  a  Student  Self-Rating  or  Teacher  Rating  is  at  the 

same  level  as  a  score  on  the  Performance  Test  (e.g.,  high  Student 
Self-Rating  and  a  high  Performance  Test  score,  average  Teacher 
Rating  and  an  average  Performance  Test  score,  low  Student  Self- 
Rating  and  a  low  Performance  Test  score. 
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These  definitions  along  with  Table  1  will  be  helpful  when 
the  Ratings  and  Performance  Test  scores  for  individual  skills, 
total  instruments. 


interpreting 
scales,  and 


Table  1 

Relationship  of  the  Skills  Listed  on  the  Student  Self-Ratings  and 
Teacher  Ratings  with  the  Items  Included  on  the  Performance  Test 


Student  Self-Ratings  and 

Teacher  Ratings  Skills 

Performance  Test  Items 

(Range  of  Responses) 

(Range  of  Responses) 

4-"Can  Do  Well"  (High) 

"Correct  Items"/ 

3-"Can  Do  Fairly  Well"  (Average) 
2-"Cannot  Do  Too  Well"  (Average) 

"Incorrect  Items" 

1-"Cannot  Do"  (Low) 


Whole  Numbers 

1.  Read,  write,  and  count  whole  numbers 


2.  Add  and  subtract  whole  numbers 


3.  Multiply  and  divide  whole  numbers 


1-6  (High:  5-6) 

(Average:  3-4) 
(Low:  1-2) 

7-12  (High:  5-6) 

(Average:  3-4) 
(Low:  1-2) 

13-18  (High:  5-6) 

(Average:  3-4) 
(Low:  1-2) 


4.  Add,  subtract,  multiply,  and  divide 

whole  numbers  to  solve  word  problems  19-22  (High:  4) 

(Average:  2-3) 
(Low:  1) 

5.  Round  off  whole  numbers  23-25  (High:  3) 

(Average:  2) 
(Low:  1) 


(High:  3-4.00) 

(High:  18-25) 

(Average:  2-2.99) 

(Average:  9-17)  (n=25 

(Low:  1-1.99) 

(Low:  1-8) 

items) 
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Fractions 


6.  Read  and  write  common  fractions 


7.  Add  and  subtract  common  fractions 


8.  Multiply  and  divide  common  fractions 


26-31  (High:  5-6) 

(Average:  3-4) 
(Low:  1-2) 

32-43  (High:  9-12) 

(Average:  5-8) 
(Low:  1-4) 

44-55  (High:  9-12) 

(Average:  5-8) 
(Low:  1-4) 


9.  Add,  subtract,  multiply,  and  divide 

common  fractions  to  solve  word  problems 


56-59  (High:  4) 

(Average:  2-3) 
(Low:  1) 


(High:  3-4.00) 

(Average:  2-2.99) 
(Low:  1-1.99) 


(High:  24-34) 

(Average:  13-23)  (n=34  items) 
(Low:  1-12) 


Decimals 


10.  Read  and  write  decimals 


11.  Add  and  subtract  decimals 


12.  Multiply  and  divide  decimals 


60-63  (High:  4) 

(Average:  2-3) 
(Low:  1) 

64-75  (High:  9-12) 

(Average:  5-8) 
(Low:  1-4) 

76-87  (High:  9-12) 

(Average:  5-8) 
(Low:  1-4) 


13.  Add,  subtract,  multiply,  and  divide 

common  decimals  to  solve  word  problems 


88-91  (High:  4) 

(Average:  2-3) 
(Low:  1) 


14.  Solve  problems  involving  dollars  and 
cents 


92-99  (High:  6-8) 

(Average:  3-5) 
(Low:  1-2) 


15.  Round  off  decimals 


100-102  (High:  3) 

(Average:  2) 
(Low:  1) 


(High:  3-4.00) 
(Average:  2-2.99) 
(Low:  1-1.99) 


(High:  30-43) 

(Average:  16-29)  (n=43  items) 
(Low:  1-15) 


Percent 

16.  Read  and  write  percents  103-108  (High:  5-6) 

(Average:  3-4) 
(Low:  1-2) 


17.  Solve  word  problems  involving  percents  109-111  (High:  3) 

(Average:  2) 
(Low:  1) 


(High:  3-4.00) 

(High:  7-9) 

(Average:  2-2.99) 

(Average:  4-6)  (n=9  items) 

( Low:  1  -1 . 99) 

(Low:  1-3) 

Mixed  Operations 


18.  Change  fractions  to  decimals, 
percents  to  fractions, 
fractions  to  percents, 
percents  to  decimals, 
decimals  to  percents, 
fractions  or  mixed  numbers 
to  decimal  fractions,  decimal 
fractions  to  fractions  or 

mixed  numbers  112-120  (High:  7-9) 

(Average:  4-6) 
(Low:  1-3) 


19. 


20. 


Solve  word  problems  by  selecting 
and  using  the  correct  order  of 
addition,  subtraction,  multiplication, 
and  division  for  whole  numbers, 


fractions,  decimals,  and  percents 

121-123  (High:  3) 

(Average: 

2) 

(Low:  1) 

Find  averages  (means) 

124-126  (High:  3) 

(Average: 

2) 

( Low :  1 ) 

21.  Do  written  calculations  quickly 


N/A 


(High:  3-4.00) 

(High:  11-15) 

(Average:  2-2.99) 

(Average:  6-10)  (n=15 

(Low:  1-1.99) 

(Low:  1-5) 

items) 
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Measurement  and  Calculation 

22.  Read  numbers  or  symbols  from  time, 

weight,  distance,  and  volume  measuring 
scales 

127-133 

(High:  6-7) 

(Average:  3-5) 

(Low:  1-2) 

23.  Use  measuring  scales  to  determine  an 
object's  weight,  distance,  and  volume 
in  standard  (English)  units 

N/A 

24.  Use  measuring  scales  to  determine  an 
object's  weight,  distance,  and  volume 
in  metric  units 

N/A 

25.  Do  basic  metric  conversions  involving 
weight,  distance,  and  volume 

134-139 

(High:  5-6) 

(Average:  3-4) 

(Low:  1-2) 

26.  Solve  problems  involving  time,  weight, 
distance,  and  volume 

140-146  (High:  6-7) 

(Average:  3-5) 

(Low:  1-2) 

27.  Use  a  calculator  to  solve  problems 
involving  addition,  subtraction, 
multiplication,  and  division 

N/A 

(High:  3-4.00) 

(Average:  2-2.99) 

(Low:  1-1.99) 

(High:  15-20) 

(Average:  8-14)  (n=20  items) 
(Low:  1-7) 

I 

Estimation 

28.  Determine  if  a  solution  or  answer  to 
a  mathematics  problem  is 
reasonable 


(High:  4) 

(Average:  2-3)  (n=4  items) 
(Low:  1) 


(High:  3-4.00) 
(Average:  2-2.99) 
(Low:  1-1.99) 


147-150  (High:  4) 

(Average:  2-3) 
(Low:  1) 


(High:  3-4.00) 
(Average:  2-2.99) 
(Low:  1-1.99) 


Total  Instrument 


(High:  101-150)  | 

(Average:  51-100)  (n=150  items) 
(Low:  0-50) 


Individual  Skills 


The  assessment  of  individual  skills  using  the  Student  Self-Ratings, 
Teacher  Ratings,  or  Performance  Test  was  described  previously.  Correct  or 
incorrect  answers  on  the  Performance  Test  may  be  compared  to  responses  on 
the  Student  Self-Ratings  or  Teacher  Ratings.  The  scores  on  either  the 
Student  Self-Rating  and/or  Teacher  Rating  instruments  may  be  compared  with 
corresponding  Performance  Test  scores  for  individual  skills.  The  comparisons 
relate  whether  the  Student  Self-Ratings  and/or  Teacher  Ratings  are  con¬ 
sistent,  overestimated,  or  underestimated  relative  to  a  student's  score  on  the 
Performance  Test  for  an  individual  skill.  Table  2  and  the  text  which  follows 
it  provide  examples  of  how  scores  on  the  Student  Self-Rating  or  Teacher 
Rating  instruments  can  be  compared  and  interpreted  with  scores  on  the  Per¬ 
formance  Test  for  individual  skills. 

Table  2 

Examples  of  Comparisons  and  Interpretations  of  Student  Self-Ratings 
and  Teacher  Ratings  With  Performance  Test  Scores 
for  An  Individual  Skill 


Skill 

Student  Self-Rating 

Teacher  Rating 

Performance 

Test  Score 

Read,  Write 

,  4(overestimation) 

3(overestimation ) 

1 

and  Count 

Whole 

2(overestimation ) 

1  (consistent) 

2 

Numbers 

4(consistent) 

1  (underestimation  ) 

6 

1  (underestimation) 

2(  underestimation ) 

5 

2(consistent) 

4(ove  rest  imation ) 

3 

3(consistent) 

3(consistent) 

4 

If  on 

the  "Whole  Numbers" 

Scale,  skill  #1:  Read, 

Write,  and  Count 

Whole  Numbers,  a  rating  of  "4"  or  "Can  Do  Well"  was  obtained  on  the  Student 
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Self-Ratings  and  a  score  of  1  (1  of  6  items  correct)  was  obtained  on  the 
Performance  Test  for  an  individual  student,  this  would  indicate  an  overesti¬ 
mation  of  the  student's  skill  level.  The  teacher  may  use  the  results  to  assist 
and  counsel  the  student  to  better  understand  his/her  learning  strengths.  A 
close  examination  of  the  Performance  Test  could  help  specify  student  learning 
strengths  and  problems. 

Conversely,  a  score  of  "2"  or  "Cannot  Do  Too  Well"  on  the  Teacher 
Ratings  and  a  total  score  of  "5"  on  items  1-6  on  the  Performance  Test  would 
indicate  an  underestimation  of  a  student's  skill.  Similarly,  the  teacher  could 
examine  his/her  observations  and  perceptions  of  the  student  to  acquire  a 
clearer  idea  of  the  student's  learning  strengths  based  on  the  results  of  the 
Performance  Test. 

A  score  of  "3"  or  "Can  Do  Fairly  Well"  on  the  Student  Self-Ratings  and 
a  score  of  "4"  on  the  Performance  Test  may  indicate  a  relatively  accurate  and 
consistent  diagnosis  of  a  student's  mathematics  skill  level.  The  scores  on  the 
Student  Self-Ratings  and  Teacher  Ratings  may  be  compared  with  the  Perfor¬ 
mance  Test  scores  and  interpreted,  similarly,  for  the  other  27  individual 
skills  contained  in  each  of  the  7  scales. 

Scales 

Average  scale  ratings  on  the  Student  Self-Ratings  or  Teacher  Ratings 
may  be  compared  to  scale  scores  on  the  Performance  Test.  The  comparisons 
relate  whether  the  student  Self-Ratings  or  Teacher  Ratings  are  consistent, 
overestimated,  or  underestimated  relative  to  a  student's  score  on  the  Per¬ 
formance  Test  for  an  individual  scale.  Table  3  and  the  text  which  follows  it 
provide  examples  of  how  average  scale  scores  on  the  Student  Self-Rating  or 
Teacher  Rating  instruments  can  be  compared  and  interpreted  with  scale  scores 
on  the  Performance  Test  for  individual  scales. 
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Table  3 


Examples  of  Comparisons  and  I nterpretations  of  Student  Self-Ratings 
and  Teacher  Ratings  With  Performance  Test  Scores 
for  An  Individual  Scale 


Scale 

Student  Self-Rating 

Performance 

Teacher  Rating  Test  Score 

Fractions 

2.65(consistent) 

3 . 44(overestimation ) 

15 

3 . 90(overestimation ) 

2.45(consistent) 

22 

2.88(consistent) 

2. 63(consistent) 

20 

3. 50(  overestimation) 

2. 78(overestimation) 

10 

1 . 96(underestimation  ) 

2. 22  (underestimation) 

29 

3. 24(consistent) 

1 .80(underestimation) 

33 

If  on  the  "Fractions"  scale  (items  6-9),  an  average  rating  of  3.90  on  the 
Student  Self-Ratings  and  a  score  of  22  (22  of  34  items  correct)  was  obtained 
on  the  Performance  Test  "fractions"  scale  for  an  individual  student,  this 
would  indicate  an  overestimation  of  a  student's  skill  level.  Similar  to  the  case 
of  individual  skills,  the  teacher  may  use  the  results  to  assist  and  counsel  the 
student  to  better  understand  his/her  learning  strengths. 

An  average  score  of  2.22  on  the  Teacher  Ratings  and  a  total  scale  score 
of  29  (29  of  32  items  correct)  obtained  on  the  Performance  Test  "fractions" 
scale  for  an  individual  student  would  suggest  an  underestimation  of  a  stu¬ 
dent's  skill  level.  The  teacher  may  also  examine  his/her  perception  of  the 
student  to  obtain  a  better  idea  of  the  student's  learning  strengths.  A  close 
examination  of  the  Performance  Test  results  could  specify  student  learning 
strengths  and  problems. 
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An  average  score  of  3.24  on  the  Student  Self-Ratings  and  a  score  of  33 
(33  of  34  items  correct)  on  the  "fractions"  scale,  on  the  Performance  Test 
probably  would  indicate  a  relatively  accurate  and  consistent  diagnosis  of  a 
student's  skill  level.  The  scores  on  the  Student  Self-Ratings  and  Teacher 
Ratings  may  be  compared  with  the  Performance  Test  scores  and  interpreted, 
similarly,  for  the  other  6  scales. 

Total  Instrument 

Average  ratings  on  the  total  Student  Self-Ratings  or  Teacher  Ratings 
may  also  be  compared  to  total  scores  on  the  Performance  Test.  The  compari¬ 
sons  relate  whether  the  average  ratings  on  the  total  Student  Self-Ratings  or 
Teacher  Ratings  are  consistent  with,  overestimated,  or  underestimated  relative 
to  a  student's  total  score  on  the  Performance  Test.  Table  4  and  the  text 
which  follows  it  provide  examples  of  how  average  scores  on  the  total  Student 
Self-Rating  or  Teacher  Rating  instruments  can  be  compared  and  interpreted 
with  total  scores  on  the  Performance  Test. 

Table  4 

Examples  of  Comparisons  and  I nterpretations  of  Total  Student 
Self-Ratings  and  Teacher  Ratings  With  Total  Performance 

Test  Scores 


Performance 

Student  Self-Rating  Teacher  Rating  Test  Score 


1 . 14(consistent) 

3. 75(overestimation) 

22 

3. 23(overestimation) 

2.82(consi.stent) 

76 

2. 48(overestimation) 

3 . 53(overestimation ) 

37 

3. 76(consistent) 

3. 94(consistent) 

138 

1 . 53(underestimation ) 

2. 32(  underestimation) 

147 

2. 64(consistent) 

1 . 25(underestimation) 

53 
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If  an  average  rating  of  2.48  on  the  Student  Self-Ratings  and  a  score  of 
37  (37  of  150  items  correct  on  the  total  instrument)  on  the  Performance  Test 
for  an  individual  student  would  indicate  an  overestimation  of  a  student's 
mathematics  skills.  The  teacher,  again,  may  use  the  results  and  counsel  the 
student  to  better  understand  and  identify  his/her  learning  strengths. 

An  average  score  of  2.32  on  the  total  Teacher  Ratings  and  a  total 
instrument  score  of  147  (147  of  150  items  correct)  obtained  on  the  Performance 
Test  for  an  individual  student  would  suggest  an  underestimation  of  a  stu¬ 
dent's  skills.  The  teacher  could  also  examine  his/her  perceptions  of  the 
student  to  obtain  a  clearer  idea  of  the  student's  learning  strengths.  There¬ 
fore,  a  close  examination  of  the  Performance  Test  could  identify  specific 
student  learning  strengths  and  problems,  and  suggest  the  necessary  learning 
prescriptions  necessary  to  increase  the  student's  skill  levels. 

An  average  score  of  2.64  on  the  Student  Self-Ratings  and  a  score  of  53 
(53  of  150  items  correct  on  the  total  instrument)  on  the  Performance  Test 
most  likely  indicates  a  relatively  accurate  and  consistent  diagnosis  of  a  stu¬ 
dent's  skill  level. 
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Appendix  A 


Generalizable  Mathematics  Skills 
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s  and  Programs 

tics  Occs. 

Industrial  Occupations 

-> 

Child  Development 

Cooperative  Work  Training  (CWT) 

All  Home  Economics  Occupations  Programs 

Air  Conditioning 

Heating 

Appliance  Repair 

Automotive  Services 

Body  and  Fender  Repair 

Auto  Mechanics 

Aircraft  Maintenance 

Commercial  Art 

Construction  and  Building  Trades 

Carpentry 

Industrial  Maintenance 

Diesel  Mechanic 

Drafting 

Electrical  Occupations 

Industrial  Electrician 

Electronic  Occupations 

Radio/Television  Repair 

Graphic  Arts 

Machine  Shop 

Combine  Metal  Trades 

Welding 

Tool  and  Die  Making 

Cosmetology 

Refrigeration 

Small  Engine  Repair 

Millwork  and  Cabinet  Making 

Industrial  Cooperative  Education 

Cooperative  Work  Training  (CWT) 

Truck  Driving 

Warehousing 

Home  Remodeling  and  Renovation 

Custodial  Maintenance 

Communications  and  Media  Specialist 

All  Industrial  Occupations  Programs 

1 

ALL  VOCATIONAL  TRAINING  AREAS  AND  PROGRAMS 


KEY 

■  -  High  Generalizability 
(x  =  5.01  -  7.00) 

— I  -  Medium  Generalizability 
(X  =  3.00  -  5.00) 

~ 1  -  Low  Generalizability 
LJ  (x  =  100  -  2.99) 


Mathematics  Skills 


Whole  Numbers 

1  Read,  write,  and  count  single  and  multiple  digit  whole  numbers 

2.  Add  and  subtract  single  and  multiple  digit  whole  numbers 

3.  Multiply  and  divide  single  and  multiple  digit  whole  numbers 

4.  Use  addition,  subtraction,  multiplication,  and  division  to  solve  word  problems  with  single  and  multiple  digit  whole 
numbers 

5  Round  off  single  and  multiple  digit  whole  numbers 

Fractions 

6  Read  and  write  common  fractions 

7  Add  and  subtract  common  fractions 

8  Multiply  and  divide  common  fractions 

9.  Solve  word  problems  with  common  fractions 

Decimals 

10.  Carry  out  arithmetic  computations  involving  dollars  and  cents 

1 1  Read  and  write  decimals  in  one  and  more  places 

12  Round  off  decimals  to  one  or  more  places 

13  Multiply  and  divide  decimals  in  one  or  more  places 

14  Add  and  subtract  decimals  in  one  or  more  places 

15  Solve  word  problems  with  decimals  in  one  or  more  places 

Percent 

16  Read  and  write  percents 

17.  Compute  percents 

All  Industrial  Occupations  Programs 


I 

I 

I 


ALL  VOCATIONAL  TRAINING  AREAS  AND  PROGRAMS 


ALL  VOCATIONAL  TRAINING  AREAS  AND  PROGRAMS 


Appendix  B 


Additional  Important  Mathematics  Skills 
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I 


Business/  Marketing,  and  Management  Occupations  Programs 


Program 

Advertising  Services 
General  Merchandise  (Sales) 


Business  Data  Processing  Systems 
Computer  Programming 


Secretarial 


Office  Occupations 


Skill 

•  Calculate  discounts  and  use 
them  in  problems 


•  Use  of  base  2  and  16  arithmetic 

•  Understand  algebraic  concepts 

•  Provide  proof  of  results  obtained 


•  Use  touch-method  of  using 
calculator 

•  Accuracy  and  speed  in  using 
calculator 


•  Verify  answers 


Health  Occupations  Programs 


Program 


Skill 


Practical  Nursing 


Read  a  centigrade  thermometer 
and  convert  to  Fahrenheit 
Solve  word  problems  using 
measurements  based  on 
apothecaries'  and  household 
measurements 
Solve  ratio  and  proportion 
problems 

Use  complex  metrics  and 
apothecaries'  systems 


I 


3 


Industrial  Occupations  Programs 


Mathematics 


Program 


Skill 


Air  Conditioning  •  Use  basic  trigonometric  function 

Heating 

Refrigeration 

Electronics  Occupations 

Machine  Shop 

Tool  and  Die  Making 


Auto  Mechanics 


•  Apply  degrees  of  rotation  to 
a  graph 


Commercial  Art 


•  Enlarge  or  reduce  proportional 
sizes 


Diesel  Mechanics 


•  Convert  pounds  to  foot  pounds 
and  foot  pounds  to  pounds 


Electrical  Occupations 
Electronics  Occupations 


•  Find  square  root 

•  Use  binary  math 

•  Use  scientific  notation 

•  Use  algebraic  equations  and 
formulas  for  solving  unknowns 

•  Use  a  measuring  device  to 
measure  electronic  quantities 


Air  Conditioning 
Combine  Metal  Trades 
Machine  Shop 
Welding 


•  Use  basic  geometry  (e.g., 
area,  circumference,  volume) 


Machine  Shop  •  Use  algebra 

Tool  and  Die  Making 

Industrial  Electrician 

Electronics  Occupations 

Electrical  Occupations 


Electronics  Occupations 
Electrical  Occupations 


•  Check  answers  for  accuracy 

•  Find  formulas  to  solve  problems 


Appendix  C 


Student  Self-Ratings 
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GENERALIZABLE  VOCATIONAL  MATHEMATICS  SKILLS  ASSESSMENT 
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Industrial  Occupations: 
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Directions:  Indicate ,  by  circling  the  number 3  how  well  you  believe  you  can  do  each  of  the  following  mathematics 
skills. 
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Mathematics  Skills  Degree  of  Skill 
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Add,  subtract,  multiply,  and  divide  common 
fractions  to  solve  word  problems 


Mathematics  Skills  Degree  of  Skill 
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Use  a  calculator  to  solve  problems  involving  addition, 
subtraction,  multiplication,  and  division 


Mathematics  Skills  Degree  of  Skill 


O') 


o 

a  - 
0} 

U 

o  "a3 
O  5 

c  > 
ra  -r 

u  •- 

TO 


O 

Q  = 
0) 

■M  $ 

o 

C  o 
c  o 

TO  J_ 

U 


o 

Q 


o 

c 

c 

TO 

U 


ro 


<\j 


TO 
v-o 
v — i 

"3 

TO 

TO 

o 

•3 

40 

« 

s 

0) 

-s; 

l 


W 

s 

o 

u 

Si 

4-> 

40 

TO 

E 

3 

o 

a) 

rQ 

-C 

<3 

+-< 

TO 

TO 

E 

40 

S 

TO 

O 

§ 

+-> 

o 

o 

!_ 

TO 

03 

£ 

40 

W 

C 

TO 

*3 

Sh 

3 

or 

| 

c 

3 

O  TO 

O 

tj  X! 

Si 

TO 

O  £ 

TO 

in  O 

0) 

in 

0 

TO  <0 

« 

TO 

<+-  t- 

TO 

to.2 

C3i 

S 

c 

z 

o 

o 

h- 

TO  -Q 

4-»  O 

TO 

t~o 

r-O 

£ 

< 

Q  a. 

03 

H 

to 

28. 

40 

,K 

LU 

H 

STOP J  YOU  ARE  FINISHED 


GENERALIZABLE  VOCATIONAL  MATHEMATICS  SKILLS  ASSESSMENT 

STUDENT  SELF-RATINGS 
SKILL  PROFILE 


Scales/Skills  Item  Number 

WHOLE  NUMBERS 

read,  write,  and  count  1 

add  and  subtract  2 

multiply  and  divide  3 

solve  word  problems  4 

round  off  5 

FRACTIONS 

read  and  write  6 

add  and  subtract  7 

multiply  and  divide  8 

solve  word  problems  9 

DECIMALS 

read  and  write  10 

add  and  subtract  11 

multiply  and  divide  12 

solve  word  problems  13 

solve  dollars  and  cents  problems  14 

round  off  15 

PERCENT 

read  and  write  16 

solve  problems  17 

MIXED  OPERATIONS 

change  fractions,  decimals,  percents, 

mixed  numbers,  and  decimal  fractions  18 

solve  word  problems  19 

find  averages  20 

do  written  calculations  quickly  21 

MEASUREMENT  AND  CALCULATION 

read  time,  weight,  distance,  and  volume  scales  22 

use  standard  weight,  distance,  and  volume  scales  23 

use  metric  weight,  distance,  and  volume  scales  24 

do  basic  metric  weight,  distance,  and  volume 

conversions  25 

solve  time,  weight,  distance,  and  volume  word 

problems  26 

use  a  calculator  to  solve  addition,  subtraction, 

multiplication,  and  division  problems  27 

ESTIMATION 

determine  if  a  solution  or  answer  to  a 

mathematics  problem  is  reasonable  28 


Student  Self-Rating 


Total 

Average(/5) 


Total 

Average(/4) 


Total 

Average(/6) 


Total 

Average(/2) 


Total 

Average(/4) 


Total 

Average(/6) 

Total 


TOTAL 

AVERAGE  (/28) 


OVER 


Comments 
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Add,  subtract,  multiply,  and  divide  common 
fractions  to  solve  word  problems 
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GENERALIZABLE  VOCATIONAL  MATHEMATICS  SKILLS  ASSESSMENT 

TEACHER  RATINGS 
SKILL  PROFILE 


Scales/Skills  Item  Number 

WHOLE  NUMBERS 

read,  write,  and  count  1 

add  and  subtract  2 

multiply  and  divide  3 

solve  word  problems  4 

round  off  5 

FRACTIONS 

read  and  write  6 

add  and  subtract  7 

multiply  and  divide  8 

solve  word  problems  9 

DECIMALS 

read  and  write  10 

add  and  subtract  11 

multiply  and  divide  12 

solve  word  problems  13 

solve  dollars  and  cents  problems  14 

round  off  15 

PERCENT 

read  and  write  16 

solve  problems  17 

MIXED  OPERATIONS 

change  fractions,  decimals,  percents, 

mixed  numbers,  and  decimal  fractions  18 

solve  word  problems  19 

find  averages  20 

do  written  calculations  quickly  21 

MEASUREMENT  AND  CALCULATION 

read  time,  weight,  distance,  and  volume  scales  22 

use  standard  weight,  distance,  and  volume  scales  23 

use  metric  weight,  distance,  and  volume  scales  24 

do  basic  metric  weight,  distance,  and  volume 

conversions  25 

solve  time,  weight,  distance,  and  volume  word 

problems  26 

use  a  calculator  to  solve  addition,  subtraction, 

multiplication,  and  division  problems  27 

ESTIMATION 

determine  if  a  solution  or  answer  to  a 

mathematics  problem  is  reasonable  28 
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Directions ;  Do  each  of  the  following  problems  by  circling  the  correct  answer.  Please  use  the  scratch  paper 
provided,  to  work  out  your  answers. 
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Ms.  Smith  typed  126  pages  on  Wednesday.  On  Thursday  she  typed  58  pages.  How 
many  more  pages  did  Ms.  Smith  type  on  Wednesday  than  on  Thursday? 
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131.  How  long  is  the  nail  to  the  nearest  tenth  of  a  centimeter? 
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141.  A  customer  bought  10  pounds  of  pork  chops,  6  pounds  8  ounces  of  steak,  1  pound 
of  bacon,  and  4  pounds  15  ounces  of  chicken.  How  much  meat  did  the  customer 

buy? 
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GENERALIZABLE  VOCATIONAL  MATHEMATICS  SKILLS  ASSESSMENT 

PERFORMANCE  TEST 
SKILL  PROFILE 


Scales/Skills  Item  Number  Number  Correct 


WHOLE  NUMBERS 


read,  write,  and  count 

1 

to 

6 

add  and  subtract 

7 

to 

12 

multiply  and  divide 

13 

to 

18 

solve  word  problems 

19 

to 

22 

round  off 

23 

to 

25 

Total 

FRACTIONS 

read  and  write 

26 

to 

31 

add  and  subtract 

32 

to 

43 

multiply  and  divide 

44 

to 

55 

solve  word  problems 

56 

to 

59 

Total 

DECIMALS 

read  and  write 

60 

to 

63 

add  and  subtract 

64 

to 

75 

multiply  and  divide 

76 

to 

87 

solve  word  problems 

88 

to 

91 

solve  dollars  and  cents 

problems 

92 

to 

99 

round  off 

100 

to 

102 

Total 

PERCENT 

read  and  write 

103 

to 

108 

solve  problems 

109 

to 

111 

Total 

MIXED  OPERATIONS 

fractions  to  decimals  to 

percents, 

mixed  numbers 

r 

and  decimal  fractions 

112 

to 

120 

solve  word  problems 

121 

to 

123 

find  averages 

124 

to 

126 

Total 

MEASUREMENT  AND  CALCULATION 

read  time,  weight,  distance,  and 

volume  scales 

127 

to 

133 

do  metric  weight,  distance,  and  volume 

conversions 

134 

to 

139 

solve  time,  weight,  distance,  and 

volume 

word  problems 

140 

to 

146 

Total 

ESTIMATION 

determine  if  a  solution 

or  answer 

to  a  mathematics 

problem  is  reasonable 

147 

to 

150 

Total 

TOTAL  Score 

OVER 


Comments 
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Performance  Test  Answer  Key 


1) 

c 

28) 

c 

55) 

a 

82) 

c 

109)  b 

136) 

b 

2) 

a 

29) 

a 

56) 

b 

83) 

d 

110)  c 

137) 

a 

3) 

a 

30) 

b 

57) 

d 

84) 

a 

111)  d 

138) 

c 

4) 

d 

31) 

c 

58) 

a 

85) 

b 

112)  d 

139) 

d 

5) 

a 

32) 

c 

59) 

c 

86) 

a 

113)  b 

140) 

b 

6) 

b 

33) 

d 

60) 

b 

87) 

c 

114)  a 

141 ) 

d 

7) 

c 

34) 

a 

61) 

c 

88) 

c 

115)  d 

142) 

b 

8) 

a 

35) 

d 

62) 

a 

89) 

b 

116)  c 

143) 

c 

9) 

b 

36) 

b 

63) 

d 

90) 

a 

117)  a 

144) 

b 

10) 

d 

37) 

c 

64) 

b 

91) 

d 

118)  d 

145) 

d 

11) 

a 

38) 

d 

65) 

a 

92) 

d 

119)  c 

146) 

a 

12) 

d 

39) 

b 

66) 

d 

93) 

a 

120)  c 

147) 

d 

13) 

b 

40) 

c 

67) 

a 

94) 

b 

121)  a 

148) 

b 

14) 

a 

41) 

d 

68) 

c 

95) 

c 

122)  b 

149) 

c 

15) 

d 

42) 

b 

69) 

b 

96) 

a 

123)  c 

150) 

a 

16) 

c 

43) 

a 

70) 

a 

97) 

d 

124)  c 

17) 

d 

44) 

c 

71) 

c 

98) 

c 

125)  a 

18) 

b 

45) 

d 

72) 

d 

99) 

a 

126)  b 

19) 

d 

46) 

c 

73) 

b 

100) 

a 

127)  c 

20) 

a 

47) 

b 

74) 

c 

101) 

b 

128)  a 

21) 

c 

48) 

a 

75) 

d 

102) 

d 

129)  d 

22) 

b 

49) 

c 

76) 

a 

103) 

c 

130)  b 

23) 

a 

50) 

b 

77) 

d 

104) 

a 

131)  c 

24) 

c 

51) 

a 

78) 

b 

105) 

b 

132)  d 

25) 

d 

52) 

d 

79) 

a 

106) 

b 

133)  b 

26) 

b 

53) 

b 

80) 

c 

107) 

c 

134)  d 

27) 

d 

54) 

d 

81) 

d 

108) 

a 

135)  a 
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There  are  four  generalizable  mathematics  skills  which  are  assessed  using 
the  Student  Self-Ratings  and  Teacher  Ratings  but  not  assessed  using  the 
Performance  Test.  These  skills  include:  (a)  Mixed  Operations,  Skill 
#20-Perform  written  calculations  quickly,  (b)  Measurement  and  Calculation, 
Skill  #23-Use  a  measuring  device  to  determine  an  object's  weight,  distance,  or 
volume  in  standard  (English)  units,  (c)  Measurement  and  Calculation,  Skill 
#24-Use  a  measuring  device  to  determine  an  object's  weight,  distance,  or 
volume  in  Metric  units,  and  (d)  Measurement  and  Calculation,  Skill  #27-Use  a 
calculator  to  perform  basic  arithmetic  operations  to  solve  problems.  These 
four  skills  are  not  assessed  using  the  Performance  Test  because  they  are 
more  appropriately  assessed  using  actual  "hands-on"  procedures  by  using 
equipment,  such  as,  measuring  devices  and  calculators.  When  assessing  these 
skills,  teachers  should  use  equipment  and  materials  used  in  their  courses  or 


programs . 


